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A  k-varlate  Bernoulli  distribution  with  k+1  parameters  Is  obtained 
as  a  shock  model  In  which  shocks  are  fatal  to  single  components  only  or 
to  all  components  simultaneously  in  a  k-component  system.  The  maximum 
likelihood  estimator  for  model  parameters  is  fully  characterized.  A 
simple  iterative  scheme  Is  Investigated,  and  It  Is  shown  that  the  scheme 
converges  to  the  MLE  for  any  seed  In  an  Interval  whose  endpoints  depend 
only  on  the  observed  sample. 

I.  INTRODUCTION 

Let  Zq,Z . . . ,Z^  be  Independent  Bernoulli  variables,  each  with  its 
own  parameter  p^,  1"0,..., k.  Let 

Y^  m  min(Zg,Z^)  1|,1|  •  •  •  .k, 

and  consider  the  distribution  of  the  random  vector  Y  -  (Y.,...,Yk). 

This  distribution  is  a  (k+ 1) -parameter  submodel  of  the  multivariate 
Bernoulli  distributions  studied  In  Boyles  and  Samanlego  (1980).  This 
paper  is  dedicated  to  maximum  likelihood  estimation  for  this  submodel, 
henceforth  to  be  denoted  by  MVB(k+  1). 

The  model  MVB(k+ 1)  can  be  motivated  as  follows:  Suppose  a  k 
component  system  may  be  subjected  to  two  kinder  of  shocks  during  an 
observation  period  of  length  TQ.  A  shock  of  type  1  Is  fatal  to  a  >or 

‘  JL 

single  component  and  has  no  effect  on  other  components.  Define 

i‘0  if  shock  fetal  to  component 

1  occurs  by  time  T. 

Zi  -  <  0 

<  1  otherwise . 
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A  shock  of  type  2  Is  simultaneously  fatal  to  all  components.  Define 


Z 


1 


If  universal  shock 
occurs  by  time  Tq 

otherwise . 


and  define 


1)*  i"0, 1, . . .  ,k. 


Then  » 1  If  and  only  If  no  shock  fatal  to  component  1  occurs  by  time 
Tq.  The  model  above  may  be  viewed  as  a  discrete  analogue  of  the  submodel 
of  Marshall  and  Olkln's  (1967)  multivariate  exponential  (MVE)  distribu¬ 
tion  with  single  and  universal  shocks  only.  This  submodel  of  the  MVE 
distribution  has  been  studied  extensively  by  Proschan  and  Sullo  (1976). 

The  general  multivariate  Bernoulli  model  studied  in  Boyles  and 

Ic 

Samanlego  (1980)  postulates  the  existence  of  2  -  1  shocks,  each  selectively 
fatal  to  a  particular  subset  of  the  k  components  of  the  system.  Maxi¬ 
mal  likelihood  estimation  for  the  general  model  poses  substantial  analy¬ 
tical  difficulties,  and  is  an  unsolved  and  perhaps  Intractable  problem. 

In  Boyles  and  Samanlego  (1980),  the  invariance  property  of  MLE's  Is  used 
to  produce  an  asymptotically  optimal  estimator  that  Is  in  fact  equal  to 
the  MLB  with  limiting  probability  one.  The  submodel  considered  In  this 
paper  Is  the  only  MVB  shock  model  we  have  examined  In  which  the  MLE  Itself 
can*  be  fully  characterized.  The  MVB(k+l)  distribution  thus  has  the 
following  characteristics:  (1)  It  Is  a  model  for  random  vectors  with 
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positively  dependent  components ,  (2)  its  parameter  space  is  of  relatively 

v 

low  dimension  (k  + 1  instead  of  2  -  1  for  the  general  model),  permitting 
efficient  estimation  with  moderate  sample  sizes,  (3)  it  is  a  reasonable 
model  in  experiments  where  the  primary  or  only  cause  of  simultaneous 
failure  of  components  is  a  catastrophic  or  universal  shock,  (4)  maximum 
likelihood  estimation  is  fully  tractable.  Because  of  these  characteristics, 
the  authors  feel  that  the  model  merits  the  separate  detailed  study  pre¬ 
sented  in  this  paper. 

In  Section  II,  we  characterize  the  MLE  of  the  parameters  of 
MVB(k+ 1) ,  showing  that  in  the  most  complex  case,  the  MLE  is  a  simple 
function  of  the  smallest  root  of  a  certain  k^  degree  polynomial.  In 
Section  III,  we  give  a  simple  iterative  scheme  which  converges  quickly 
to  the  desired  root. 


II.  MAXIMUM  LIKELIHOOD  ESTIMATION 


Suppose  a  sample  of  size  n  is  taken  from  MVB(k  + 1) .  The  likelihood 
function  for  the  sample  is  given  by 


where 


k  N, 

1 

i«l 


T-N, 


t  Tnn‘T<rr*  l/i  n  1 

L  ■  "o  %  X  "l  °  ■  pt) 


Q0-p(Y-0)  -  l-p0(l  pi»- 

T  -  #  times  Y  *  0 


(2.1) 


■  #  times  Y^  -  1  (i-1,2, . . . ,k) . 


Note  that 


tMxCNj, 


k 

,N.)  <  T  <  S  N 

*  1-1 


(2.2) 


If  T*0  then  -  0  ¥  i  so  (2.1)  becomes  L»Qg  which  is  maximized 

by  Qq  ■  1.  Since 


%  -  l-p0tl  -TT«-*i>J 

1-1 


(2.3) 


we  maximize  L  In  this  case  by  taking  either 


P0  "  0,  pt  arbitrary  (1-1 . k) 


or 


p0  arbitrary,  Pj  -  P2  -  •••  ■  Pk  “  °- 


Now  assume  0  <  T  -  N^  and  Nj  -  N^  -  ...  -  N^  —  0.  (2.1)  becomes 


N, 


N  n-N  N  *  ... 

L  "  po\  po  J)2<1"pi) 


(2.4) 


It  la  evident  from  (2.3)  that,  for  any  fixed  values  of  p^  and  p^,  Qq  Is 
maximized  by  setting  p^  -  p^  •  . . •  -  pk  -  0.  Thus  (2.4)  is  maximized  for 
fixed  Pq  and  p^  by  setting  p^  »...»■  pfe  -  0.  We  are  left  with 


N  n-N  N  N,  n-N 

L  "  P0  Q0  Pi  <PnPi>  d-Pr.Pi) 


r0rl' 


'ori* 


so  that  in  this  case  (2.1)  is  maximized  by  any  choice  of 

(p0,Plf...,Pk)  €  satisfying 

A  *  1 
P0Pl  -  n  N1 


...  -  Pk  -  0. 


Suppose  now  that  T  >  0,  Nj  >  0,...,N^  >  0,  N^  -  ...  -  N^  -  0 
where  2  <  i  <  k.  For  any  fixed  p0,Pt . ?£  we  maximize  Qq  by  setting 


Pf+1  *  •••  ■  pk  “  ln  thls  case 

(  N 


maafefea i 


ii  * . . 


wmm..  ui  m 

- -**-■ 


so  we  maximize  L  (for  fixed  Pq.Pj . PjJ)  by  setting  Px+1  -  ...  -pfc  -  0. 

Having  done  this  we  are  left  with  the  task  of  maximizing  (2.1)  subject  to 
k  —  l  >  2,  T  >  0,  Nj  >  0t...,Ng  >  0.  Thus,  without  loss  of  generality, 
we  assume  k  >  2,  T  >  0,  Nj  >  0,  N2  >  0, . . . ,Nfe  >  0  in  the  remainder  of 
this  paper. 

From  (2.1)  it  can  be  shown  that  the  likelihood  equations 
^-0  (i-0,l,...,k) 

are  equivalent  to  the  system 

k 

"  pofl  -TT<W4>] 

*  PjP0  (2.5) 

^k  “  PkP0 

where  -  n  *T  and  ■  n  (1-1,..., k).  Solutions  of  (2.5)  are  in 

one-to-one  correspondence  with  solutions  of 

k 

“  pofl  “TT<1“^i/po>3* 

Setting  x -  p”^  we  see  that  solutions  of  (2.5)  are  in  one-to-one  corres¬ 
pondence  with  solutions  of 

k 

-TfU-H  x). 

1-1  1 


1  "Ho* 


(2.6) 
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Note  that,  because  of  (2.2)  and  our  standing  assumptions  (N^  >0  ¥  i) 


we  have 


min{  1,  S  jit}  >  |J0  >  ■  max{|i1, . . . 

i*  X 


■  min^ . >  0. 


(2.7) 


Lemma  .  The  system  (2.5)  has  a  solution  p-(pn,p . p.)  €  [0,l]k+1 

-1  lf+1 

iff  (2.6)  has  a  solution  x  £  [1,^  ^ •  Moreover,  p  €  (0,1)  iff 


X  €  (l.n,.1). 


Proof.  We  already  know  that  solutions  of  (2.5)  are  in  one-to-one 

A  k+1 

correspondence  with  solutions  of  (2.6).  Assume  p  €  [0,1]  .  Then 


"  po^  "7F1(1‘pi)3  -  po  *  1 

-  A-1  -1  A  -1 
so  x  ■  pg  €  ]  and  solves  (2.6).  Conversely,  if  x  €  [1*Hq  ]  then 

*  A  -  1 

pQ  -  x  e  C^0.l]  «=  [0,1]  and,  since 


0<Hi<M0<P0, 

we  have  p1  *  €  [0,1]  for  i-1 . k. 

The  verification  of  the  second  statement  is  the  same,  but  we  will 

k+1  k  - 

include  it  for  completeness.  Assume  p  €  (0,1)  .  Then  1 1  (1-p  )  >  0 

~  i»l  1 


^0  "  p0tl  ‘  j  <  p0  <  1 
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and  x  -  p’1  €  (I41JJ1).  Conversely,  If  x  €  (1,Hq1)  then  P0 -x-1€(u0,l)c  (0,1) 
and k  since 

0  <nt  <m0  <  p0. 

A 

we  have  ^  This  completes  the  proof  of  the  lemma. 


Define 


k 

h(x)  -  Tl” (l  -UjX). 
1*1 


(2.8) 


h  is  a  ktk  degree  polynomial  with  roots  Moreover 


h(0)  -  1,  h^:1)  -X(l  ■  -)  >  0, 
u  1*1  ^0 


and  h  >  0  on  ( 


-»,U^)) •  For  we  have 

k  '-rr- 

h'(x)  — S^/IT  (1-H.x)  <  0 
1-1  lj»*l  J 


and 


h"(x) 


k 

E  E  MtUj  TT  >  0. 

1-1  j*i  1  J  i*J  1 
tti 


k 

In  particular  h'(0)  *  -  E  (ji  <  -nft  -  slope  of  line  y*l-|j  x.  This 

1-1  1  u  0 

line  and  the  curve  y-h(x)  Intersect  at  x-0  .  If  h' (0)  *  -  ^  we  have 
h(x)  >  1»HqX  *or  all  *  €  (0»H(£)3*  (In  **»!•  case  h"  >  0  forces 

^(k)  >^l01,)  1£  h'(0)  <  "  ^0  the  lln®  and  the  curve  y-h(x) 
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*  -1 

intersect  at  exactly  one  point  x  €  (0, In  fact,  we  have 
x  €  (0,|j‘l],  since  l-nQx  <  0  for  x  >  ^q1  while  h  >  0  on 


In  spite  of  the  picture,  we  are  not  excluding  the  possibility  that 
*  X  ™  X  A 

|i”  ■  or  that  x  <  1.  In  fact,  we  have 

k 

x  >.  1  iff  1  (1-Ml)  -  h(l)  <  1-Mq.  (2.9) 

Assume  now  that  TT<  1  - (jt . >  >  i-|in»  i.e.,  x  €  [0,1).  By  the  lemma, 
i-1 

k+1 

the  likelihood  equations  have  no  root  in  [0,1]  ,  so  we  seek  to  maximize 

k+1 

L  over  the  boundary  of  [0,1]  Now  since  N^  >  0  Vi  and  T  >  0,  we 

see  from  (2.1)  that  L"0  on  the  faces  [p^*0]  for  i  *0,1 . k.  On 

the  other  hand,  since 

k 

1  -M,  >7T(1-Mt)  >  1-M0 

J  i“l 
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we  have  ^  “>  T  -  Nj  >  0  (j-i,...,k).  Thus  L-0  on  the  faces 


{p1-l},  1-1 . k.  On  {pQ-l}  we  have 


n-T  JL  N. 


L  ”  {TT. c  1  *  pi> }  71  »i 


«.  n-n4 

-IT  Pi d-Pj.) 

i-i 


Thus  the  MLE  In  this  case  Is  given  by 


pn  -  1,  p  -  n  XN.  (1-1,..., k). 


(2.10) 


Now  assume  ' 1 1  (1  -  j* .)  <  1  -  |i0,  l.e. ,  x  €  [ 1,  ] .  We  will  show  that 

1-1  1 

that  the  MLE  In  this  case  is  given  by 


pQ  ■  x  ,  p£  -  jijX  (1-1,..., k). 


We  first  consider  the  likelihood  function  (2.1)  as  a  function  L  of 
x  €  [I.Hq1].  l.e.,  we  examine  its  values  along  the  curve 


(2.11) 


f  (x  »H]*»  •  •  •  ^  ^  5  P>q  3 


In  [0,l]fcfl.  First  let  x  €  (l,^1).  Then  we  have 


Now 

i(x)  a  n  ^Bn  *L(x) 

»  -  2n  x  +  (1  -y,o)0n[x-l  +  h(x)] 

■  (I-VqWMx)  +  £^[1“ +  2*i  (1-^x) 
■  -  x  +  (1-  HQ>0n[x-l  +  h(x)] 

k  X 

+  H0«nh(x)  + 

Differentiating,  we  obtain 


Since 


we  have 


Since  h(x)  > 


-a 


11 


r<x> 


-1  (1*Vko^I  +  h(x^  *oh'<x> 
” X  +  x  -  1  +  h(xj  +  h(x) 


+  x 


-1 


]• 


h’(x) 


k 

-  s (i.  n (i-^4*) 

i-l  J^i  J 


-  -  h(x) 


k 

s 

i-l 


r-st-i 

L  i  -  J 


-1  (1  -y0)[l  +  h'<x)]  ml  h '  (x) 

X'(x)  -  -  x  +  x  -  i  +  h(x)  +  ^0"X  ^  h(x) 

h(x)  +  (l-^0x)h’(x)  (l-n0)Cl+h’(x)] 

"  ”  xh(x)  +  x  -  1  +  h(x) 

-  rn.u  x'i  -hfxiifb^ 

-  [(l-^0x)  -  h(x)  J  L  xh(x)[X-!  +  h(x)]  J  * 


0,  h'(x)  <  0,  and  x-1  >  0  for  x  we  see  that 


h(x)  <  1-HqX 
h(x)  -  l-n0x 
h(x)  >  1  -^0x 


“\ 


J 
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If  x  €  )  this  means 


jt'(x)  is  (  ■  0 


1  <  X  <  X 


X  <  X  <  y, 


If  x  •  1,  we  have 


jt’(x)  <  0  ¥  x  6  (l.njV 


If  x  »  jIq  *  we  have 


je'(x)  >  0  ¥  x  €  ). 


Since  i(x)  is  continuous,  we  have  shown  that 


i(x)  ■  sup  l(x),  f(x)  >  jt (x)  for  x  +  x 


Consequently, 


L(x)  ■  sup  L(x) ,  L(x)  >  L(x)  for  x  +  x 


Now  consider  L  on  the  boundary  of  [0,1]  .  Since  T,N^  >0  ¥  i 

L  -  0  on  (pt  ■  0) ,  i*0,l, . . .  ,k.  On  {pQ«l}  we  know  from  (2.1Q)that  the 
maximum  value  of  L  is  given  by 


JL.  .  N.  .  n-N, 

TT (n^N  )  *(1  -  n~*N  )  -  L(l) . 

i-1  1  1 


Thus  p  maximizes  L  on  the  boundary  of  [0,1]  ,  so  p  is  the  MLE, 

A  -1  V+l  * 

If  x  ■  t  L  has  no  root  in  (0,1)  .  If  p  is  given  by  (2.11) 


A  ^  A 


L(p)  -  L(x)  -  L(yn  )  >  L(l). 


Thus  p  maximizes  L  on  the  boundary  of  [0,1]  ,  so  p  is  the  MLE. 

++  r- 

A 

This  completes  the  proof  that  p  given  by  (2.11)  is  the  MLE  in  the 
k 

case  < 1  * 


The  following  table  gives  the  complete  description  of  the  MLE  p  of 

rw 

the  MVB(krfl)  parameter  p  . 


N  «  T,  N£  -  0  (i  +  J) 


IT  <  Wi>  >  1"l*o 

i-1 


"+  S'  <^1"n"lNi»>*o"n"lT) 

X*  VI 

A 

O  ■  ■■■■■■■  —  ■■ 

A  vi  aJL. 

**  „  <i-»0 

:  1-1  *■  v 


1 

P0-0,  Pt  arbitrary 

(1-1,..., k) 

or 

pQ  arbitrary,  pj-.. 

.-Pk  -  0 

Vj"'1")'  »t*° 

i 

(|fcl-n"lNl,j»0-n"lT) 


•  n  N. 


A  *-l  *  -1 

P0*x  ,  pt»xn  Nt  (l-l,...,k) 

A 

where  x  Is  the  unique  solution  In 
•  1  X 

Cl.»k0  3  Of  1-HqX  -  n  (1-Utx> 
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III.  AN  ITERATIVE  SCHEME  CONVERGING  TO  THE  MLE 


In  the  following  discussion,  we  exclude  those  data  conf Iguatlons  for 

A 

which  p  can  be  computed  explicitly.  In  other  words,  we  assume  the 


following: 

(i) 

T  >  0,  Nj  >  0 . 1 

k 

(li) 

TTa-nt>  <  i-i* 

i-i 

(Hi) 

T  >  maxtNj . N^] 

(3.1) 


We  have  shown  (but  perhaps  not  stated  explicitly)  that  under  (1)  and  (11) 
the  equation 


Wox 


k 


TT(wtx) 

1-1 


(3.2) 


*  -1 

has  a  unique  solution  x  €  (1,|*q  3*  If»  In  addition,  we  assume  (ill), 
then 


k 

iru-ntn;1)  >  o 

1-1  1  u 


since  Pq  >  (1-1,2, ...  ,k) .  Thus,  (3.2)  is  not  satisfied  by  x  - 

*  -1 

so  x  €  (1,||q  ).  On  the  other  hand,  if  (ill)  falls  then  ws  have 

T-Nj  -  0  ™>  ■  0  for  some  J  ,  so  (3.2)  is  satisfied  by 

•1  *  -1 

x  -  n0  ,  hence  x  -  |aq  by  uniqueness. 


ff  -in  Ji«li  ■itmeieniMiieili 
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The  result  of  these  considerations  Is  that  (3.1)  Is  equivalent  to 

*  -i 

x  €  (1,^Q  ),  hence  the  situation  described  In  (3.1)  Is  precisely  that  In 

A  A 

which  we  have  no  explicit  formula  for  x ,  hence  no  explicit  formula  for  p  . 
We  now  give  a  simple  iterative  solution  of  (3.2)  under  conditions  (3.1). 

Let  x<°>  €  [1»Hq^]  an<*  define 


for  m  -  1,2,3, .  • .  . 
scheme  proceeds . 


1"1 

•If,  ,  .  *(s*l).  i 
-  p0  {1  -  h(  xv  ')] 


(3.3) 


Figure  II  below  Indicates  graphically  how  the  Iterative 


A(m)  * 

Theorem.  x  -*  x  as  m 

Proof.  If  x^  •  x  then  x^  ■  x  ¥  m  and  we  are  done.  Assume 
<  x.  Recall  that 


which  proves  (3.4)  with  m  replaced  by  m+1  .  We  have  now  proven  by 

a  (m) 

induction  that  {xv  '  is  a  bounded  Increasing  sequence.  Let 

-  14  A(») 

y  ■  lim  x  . 

in-*  oo 


Then,  by  the  continuity  of  h  ,  we  have 
y  -  lim  x<m> 


llm  ^1fl-h(x(“‘1))3 


or 


1-U  y  •  TT(i  -\Lty). 

i-1 


Thus  y*x,  as  required. 

""(01  A 

Now  assume  x  '  >  x.  The  proof  is  essentially  the  same  as  in  the 
preceding  case,  but  we  include  it  for  completeness.  Wc  have 


and 


(.yW.hiOxuM.I 


IV 


:  <  ;<»  <  ;<°> . 


hence 
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Now  assume 


Then 


i-v°°  <•.<;<->> 


and 


1-H0*V  -  h(xvu,/)  <  h(x)  -  W0x  , 


hence 


“  A (mfl)  ^  A(m)  ^  .  A(l)  -  A(0) 

X  <  X  <  X <  .  .  .  <  X  '  <  xv 


This  proves  by  induction  that  [x^m^ ]  is  decreasing  and  bounded  below.  Let 

A  /  v  A 

y  m  lim  xW.  Then  we  show  as  before  that  y»x  .  This  completes  the 
in-*® 
proof. 

For  any  fixed  n,  define  the  estimates  pv  ’  (m«0 ,1,2,...)  by 


;<«> . 


if  (3.1)  does  not  hold 


([x(m)]’1,  p1x(ro),...,nkx(m))  if  (3.1)  holds. 


*  (m)  A 

Corollary.  For  any  fixed  n,  pv  '  -*  p  a.s.  (m-*«). 

A*  +* 

The  proof  consists  of  quoting  the  preceding  theorem. 


Two  likely  candidates  for  are  1  and  It  would  be  useful  to 

A  (Q\ 

develop  some  criteria  for  deciding  which  x  to  use.  Also,  the  first 
*  / 1  \ 

iterate  p  '  might  be  worthy  of  study. 


J 
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